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Quick  Background 


•  As  a  cognitive  scientist,  I  am  interested  in  building 
computational  cognitive  models  of  people 

•  Our  models  are  process  descriptions  of  how  people  think, 
reason,  perceive,  etc.  They  express  behavior  through  a 
series  of  human  representations  and  strategies 

•  Building  models  of  people  facilitates  human-robot 
interaction:  People  have  expectations  on  how  to  interact 
with  other  people 
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Online  vs.  Offline 
Embodied  Cognition 


•  A  recent  drumbeat  in  cognitive  science  is  that 
cognition  is  for  action  (embodied  cognition) 

•  We  are  building  embodied  models  for  cognitive 
robotics  and  human-robot  interaction 


•  Online  Cognition:  Our  perceptual  and  motoric 
processing  are  primarily  for  here  and  now 
interactions  (Brooks) 

•  Offline  Cognition:  Even  when  decoupled  from  the 
environment,  thinking  is  grounded  in  body-based 
mechanisms  (sensing  and  motor  control) 
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Cognitive  Models 


•  We  build  models  for  online  and  offline  cognition  using 
a  computational  cognitive  architecture  (ACT-R; 

Anderson  et  al.,  2004;  Anderson,  2007) 

•  A  cognitive  architecture  is  a  specification  of  the  structure  of 
the  brain  at  a  level  of  abstraction  that  explains  how  it 
achieves  the  function  of  the  mind  (Anderson,  2007) 

•  Hybrid  symbolic  and  sub-symbolic  system 

•  Connects  with  psychological  data  (experiments)  and 
neuroscience  data  (fMRI) 

•  ACT-R  models  are  precise  process  descriptions  of  how 
people  perform  different  tasks 
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ACT-R/E  (Embodied) 
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^VS~ACT-R  can  make  predictions 

about  brain  regions  (fMRJ) 
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Embodied  Cognitive  Modeling 


•  We  use  an  MDS  robot  (Trafton  et  al.,  2010) 
[Mobile/Dextrous/Social]  named  Octavia 


•  2  color  cameras  (eyes) 

•  ToF  camera  (swiss  ranger  in  forehead) 

•  Segway  base 

•  52  DOFs 
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•  We’ve  hooked  up  ACT-R/E  to  our  robotic  sensors 
and  effectors 


•  Visual  input  enters  into  ACT-R’s  visicon  and  is  then 
processed  the  same  way  ACT-R  processes  any  other  visual 
stimuli 

•  Spatial  information  is  also  extracted  through  our  sensors 

•  ACT-R/E  motor  commands  move  the  robot 

•  Eyes  follow  attention,  then  head,  then  body 

•  Auditory  information  enters  into  the  audicon 

•  We  have  lots  of  good  sensor  /  perception  systems 
which  I  will  not  talk  about  here... 
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Gaze- Following 


•  As  a  concrete  example  of  online  embodied  cognition,  I  will 
show  a  classic  gaze-following  experiment  with  young 
children  from  Corkum  &  Moore  (1998) 

•  Debate  in  the  literature  about  maturation  (via  stages)  vs. 
learning 

•  Gaze  following  is  important  for  joint  attention,  early  social 
development,  theory  of  mind,  later  interaction 
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Corkum  &  Moore,  1 998 

Participants 


•  3  ages: 

•  6-7  months  old 

•  8-9  months  old 

•  1 0-1  I  months  old 
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Corkum  &  Moore,  1 998 

Procedure 


•  Child  came  in  and  sat  on  their  parent’s  lap 

•  Parent  was  blindfolded  so  they  could  not  give  the  child  cues 

•  Experimenter  got  child’s  attention  so  the  child  would  look 
at  the  experimenter 

Q  Child 


Toy  I  ★ 


☆  Toy  2 


Experimenter 
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Corkum  &  Moore,  1 998 

Procedure 


•  The  experimenter  looked  at  one  of  two  toys 

•  The  experimenter  did  not  point  or  talk  to  the  child  while 
looking  at  the  toy 


Toy  I  ★ 


☆  Toy  2 


\^)  Experimenter 
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Corkum  &  Moore,  1 998 

Procedure 


•  If  the  child  looked  at  the  same  toy  the  experimenter  did, 
it  was  coded  as  a  “joint  gaze” 


<Q  Child 


Toy  I  ★ 


☆  Toy  2 


Experimenter 
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Corkum  &  Moore,  1 998 

Procedure 


•  If  the  child  looked  at  the  toy  the  experimenter  was  not 
looking  at,  it  was  coded  as  a  “non-target  gaze” 

•  Navel  gazing  and  non-looks  were  not  coded 


Toy  I  ★ 


☆  Toy  2 


\^)  Experimenter 
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Corkum  &  Moore,  1 998 

Procedure 


•  There  were  three  phases  to  the  experiment 

•  For  all  trials,  experimenter  looked  at  a  toy 


Phase 

#  Trials 

Description 

Baseline 

4  (2  on  each  side) 

Toy  did  not  light  up 

Shaping 

4  (2  on  each  side) 

Regardless  of  what  infant  did,  toy  lit 
up  and  rotated  when  experimenter 

gazed  at  it 

Testing 

20  (10  on  each  side) 

Toy  lit  up  and  rotated  only  if  both 
experimenter  and  infant  gazed  at  it 
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Corkum  &  Moore,  1 998 

Scoring 


.  .  #  Joint  Gazes 

•  Accuracy  was  scored  as  - 

Total  #  Gazes 

•  Perfect  gaze-following  =  100% 

•  Random  gaze-following  =  50% 

•  Perfect  anti -gaze-foil  owing  =  0%  (should  not  happen) 
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Corkum  &  Moore,  1 998 
Research  Questions 


•  At  what  age  does  gaze-following  naturally  occur? 

•  Can  children  who  did  not  show  gaze-following  at  baseline 
learn  to  follow  gaze? 

•  This  “learning  to  follow  gaze”  hypothesis  was  quite  novel  when 
it  came  out 
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Corkum  &  Moore,  1 998 

Results 


Gaze-Following 
From  Corkum  and  Moore  (1998) 


•  At  Baseline: 

•  6-7  m.o.:  Chance 

•  8-9  m.o.:  Chance 

•  1 0-1 1  m.o.:  Joint! 

•  After  Training: 

•  6-7  m.o.:  Chance 

•  8-9  m.o.:  Joint! 

•  1 0-1 1  m.o.:  Joint! 
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Corkum  &  Moore 


•  Corkum  &  Moore  showed  that  gaze-following  can  be 

increased  during  a  lab  setting  but: 

•  They  just  showed  that  children  could  learn  how  to  follow  gaze, 
not  the  mechanism  of  learning  (e.g.,  what  type  of  learning) 

•  Were  1 0-1  I  m  old  children  at  the  right  “stage?”  Or  was  it 
continuous  learning? 

•  They  did  not  show  that  the  experimental  trial  learning  was 
what  happened  during ‘normal’  development 

•  There  are  no  process  descriptions  of  this  finding 

•  So  we  built  an  ACT-R/E  model  (details  light  here) 
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ACT-R/E  Model  of 
Gaze-Following 


•  When  the  model  is  young,  it  looks  around  the  world 
for  interesting  objects 

•  When  it  habituates  to  an  object,  it  looks  for  another 
interesting  object 

•  When  it  looks  at  the  same  object  a  person  does,  it 
gets  a  small  reward,  which  is  propagated  back  in  time 

•  In  “real-life”  the  object  of  gaze  is  relevant  to  both  parent 
and  child  (Deak  et  al.,  2008)  [reward  is  tied  to  relevance] 

•  As  model  ages,  it  gradually  learns  to  select  the  right 
spatial  information  and  follow  gaze 
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ACT-R/E  Model  of 
Gaze-Following 


•  Age  is  modeled  by  providing  the  model  with 
opportunities  to  follow  gaze 

•  The  older  the  model,  the  more  gaze-following  experience  it 
has  had 

•  After  aging  each  model,  we  ran  it  through  the  exact  same 
experimental  procedure  that  Corkum  &  Moore  (1998)  used 

•  We  collected  accuracy  at  each  age  group  for  the 
experiment  and  compared  it  to  the  empirical  data 
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ACT-R/E  Model  of 
Gaze-Following 


Gaze-Following 
From  Corkum  and  Moore  (1998) 


Age  (months) 


•  Dots  are  model  fits 

•  R2  =  .95 

•  RMSD  =  .3 

•  All  model  points  are 
within  95%  Cl 

•  Process  support  for 
learning  hypothesis, 
not  stage  maturation 

Trafton,  Harrison,  Fransen,  & 
Bugajska,  2009 
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Embodied  Cognitive  Modeling 


•  We  also  ran  our  model  up  to  1 0-1  I  m  on  our  MDS 
robot,  Octavia 


•  Several  reasons  for  emphasizing  embodied  cognition 

•  No  cheating  allowed:  very  explicit  theory  of  spatial 
cognition,  learning,  development 

•  Must  deal  with  the  complexity  of  the 
environment  (dynamic,  3D,  etc):  the 
complexity  of  the  real  world  tests  the  model, 
theory,  framework 
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- 1  I  month  old 


Level  I  Visual  Perspective  Taking 
(Based  on  Moll  &Tomasello,  2006) 
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ACT-R/E  Model  of 
Level  I  Visual  PT 


100 


80  - 


CD 

CD 

CO 

-t— » 

O) 

g 

TD 

C 

CO 


o 

c 

o 


60  - 


o 

Q. 

O 

Q. 

C 

CO 

<1) 


40  - 


20  - 


0 


Accuracy  of  Level  1  Perspective-Taking 
From  Moll  and  Tomasello  (2006) 


■  Control 
□  Experimental 


18  months 


24  months 


•  Dots  are  model  fits 

•  R2  =  .99 

•  RMSD  =  10.4 

•  All  model  points  are 
within  95%  Cl 

•  Trafton,  Harrison, 
Fransen,  &  Bugajska, 

2009 
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Beyond  Gaze-Following 


•  Gaze  following  is  a  strong  example  of  online 
embodied  cognition:  very  much  “here  and  now” 

•  What  about  another  classic  cognitive  phenomena  that 
uses  offline  embodied  cognition:  Theory  of  Mind? 
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Theory  of  Mind 


•  Recognition  that  others  can  have  beliefs,  desires  and 
intentions  different  from  your  own 

•  Typically  develops  around  age  4 

•  Ability  to  infer  what  the  beliefs,  desires  and  intentions 
of  others 

•  Critical  ability  for  interacting  with  others 

•  The  Sally-Anne  task  is  one  of  the  typical  tasks  used  to 
study  Theory  of  Mind 
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Sally- Anne  Task 
(Baron-Cohen  et  alM  1 985) 


1  y  2  y  v  3  J  4  J 

A  child  watches  while: 


1 .  Sally  puts  a  marble  in  her  box 

2.  Sally  leaves  the  room 

3.  Anne  moves  the  marble  to  Anne’s  box 

4.  Sally  returns  to  the  room 

5.  The  child  is  asked  where  Sally  believes  the  marble  is 
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Theory  of  Mind 


•  Wellman  (2001)  performed  a  meta-analysis  on  the 
existing  experiments  with  the  Sally-Anne  false-belief 
task  (and  there  were  very  many) 

•  False-beliefs  are  beliefs  that  one  may  have  but  which  are  not 
actually  true  in  the  physical  world 

•  They  built  a  statistical  model  (not  a  process  model) 

•  We  built  a  process  model  of  the  Sally-Anne  task  and 
ran  it  many  times  at  different  age  levels 

•  (Had  a  combination  of  maturation  +  learning) 
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Results 


Our  data 


R2  =  0.55 


R2  =  0.56 


H  iatt  &  Trafton,  20 1 0 
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Theory  of  Mind 


•  Work  so  far  has  focused  on  development 

•  It  is  impossible  to  program  every  situation  an  autonomous 
agent  will  encounter,  so  we  have  focused  on  learning 
because  people  are  the  best,  most  robust  learning  systems 
we  know  of 

•  Besides  building  theoretical  models  of  people  (which 
advances  cognitive  science  by  providing  process  models  of 
how  people  think,  learn,  embodied  cognition,  etc.),  we  can 
show  the  robustness  of  our  models  by  using/demonstrating 
them  in  a  different  context 
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Naval  Research  Laboratory 

& 

NCARAI 


Proudly  present 
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Embodied  Cognition 


•  We  build  computational  cognitive  models  that  takes 
embodiment  seriously 


•  Our  models  are  process  models  of  how  people  think 


•  Our  models  match  human  data  at  multiple  levels 


•  We  take  our  models  and  put  them  on  robots  so  they 
are  functional  and  have  an  embodied  presence  and 
interaction 


•  Our  approach  is  radically  different  from  typical  robotics 
architectures  (and  from  other  EC  researchers) 

•  Our  last  video  shows  interactive  behavior  with  a  focus 
on  computational  vision  and  perception... 
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Thanks! 


